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AdjufKTt questions 
Practice quest Iots 
Mathemagenic behaviors 
Ins^-ted questions ^ 

The study was conducted to' test the effect of practiccj^^or adjunct, questions on 
learning in a real-world training environment. Subjects were students enrolled irt a 
self-study course at the Navy's Interior Communications "A" School. They were 
assigned to one of three experimental groups or to a control gfpup. Students in the 
t^ experimental groups received workbooks; thos6 in the contr^ group did not. The 
workbooks varied as to the amount of questions included that wei^ identical to those 
in lesson tists or in ^ final test. In the first experimental grc^up, all the workbook 
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questions were identical; in th^ second group, half of the questiwis were ictenticai; and 
in the ' third group, none of the questions were • identical. These groups were 
subsequently referred to as the ALL, HALF, and NONE Groups. At the ei^d of the 
course, groups w^re compared on test and subtest scores, time required, and number of 
tries on lesson tests. In all cases; the performance of Group ALL subjects was 
sup^ior. Groups HALF and NONE; either in the workbook or on the lesson 
tests (NONE), perfumed no better on the final test than the control group, who had 
not. Comparisons subtests showed that practice question that are not related to 
test questions can adversely affect both p)erf ormance ancj^study time. 
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SUMMARY 

Problem ^ ^ 

^xtensive^ studies have been made of the effect of practice or adjunct questions on 
learning. Generally, findings h^ve indicated that, under the proper conditions, they can 
facilitate learning of material similar to that covered by the practice questions and 
^material unrelated or incidental to that covered by the questions. Because of the 
laboratory controls employed in these studies, however, the experimental environment is 
.quite different from that of a real-world ckESsroom situation. 

Purpose \ . 

The purpose of this research and development was to evaluate the effect of practice 
questions in a real-world training environment in which the instructional materials were 
designed to teach students to remember specific facts and procedures.. 

Approa'ch 

. The subjects were male students -enrolled in the Circuits n course at the Navy's 
Interior Communications "A" School from November 1977 through May 1978. This Qjurse 
is designed to' teach students the factual and procedural information prerequisite to their 
job. the instruction, therefore, is memory rather than performance oriented. They were 
assigned to one of three experimental groups or to a control group. Members ofthe first 
experimental group received a workbook in which* all questions were identical ty^ihose in 
lesson tests- or the finaKest; the second group, in which half the qi^stions were identical; 
and the third group, in which none of the questions were identical. The control group 
received no workbook. Although members of the experimental groujw, hereafter referred 
to as Groups ALL, HALF^ and NONE, could use the workbook in any way thh^ chose, they 
were directed %) the book to answer questions after completing a portion the lesson 
materials. Thus, they could hecqme aware of the degree of similarity betwech workbook 
cind test items. / 

At the end of the study, the four groups were compared on the following variables: 
performance on the final test and on 5ubtests' made up of items within the test; lesson test 
scores; 'time required to complete the course; and total numbefof tries on lesson tests. 
* ' ■ . 

Results " 

■ I • 

1. Group ALL students performed significantly better than the otf^r students on 
the final test. There was little difference in the performance of the other three groups, 
even tKough those in Group HALF had more exposure to the final test questions. 

f 

2. Control group students, who had no workbook, scored significantly higher on 
■ items seen once before (in lesson tests) than Group HALf and NONE students, and Groijp 

ALL students scored higher than Group HALF students on items seen twice before (in 
workbooks and lesson tests). There was no significant difference in performance of Group 
HALF, Group NONE, and control group students on items not see*i prior to tlw fina4-4e^ 
.These items are comparable to I'incidental" questions in the typical adjunct questiort- 
study. * 
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3. Group ALL students performed -significantly better than the others cm the Ipsson 
tests, foUowed by those in Gfoup HALF. There was little difference, in the performance 
of Group NONE and control g^oup men^bers. . * 

Group ALL stude<rte k-equired the least time to complete the course, followed by 
thosp in Group HALF, droup MONE, and the control group. They also had the fewest 
number of tries on lesson tests, foUowed by those in Group HALF, the cor^trol group, and 
Group NONE. 

Conclusions * 

. ^ ^ 

In a real-world learning environment, practice questions can have a detrimental 
effect on learning factual and procedural information incidental to the information 
covered by the practice questions. Fucther^.if they are not related to the test qi^stions, 
both te$t performance and study time are adversely affected. 

RecommCTidations ! , , 

1. If the intent of the instruction is to have stirients remember important pieces of 
factual and procedural inf ormatiCwi (as in the present study), .a practice item and a test 
item should be individual for each piece of information. There should be no "practice on 
information that will not be tested. If time and resource constraints do j\ot permit all 
important information to be tested, the course material slwuld be prioritized so that the 
most crucial information can be practiced and tested. The same prescription applies to' 
classroom instruction where the teacher p«-ovides practice by or^l quizzing or in 
workbooks, and to other situations in which information is to be memorized.. If the intent 
of the educational program is to transfer learning to new situations, however, practice 
items would necessarily not be the same as test items. 

2. Future research on practice questions shoiiW be accomplished in an ongling 
training program, and should include an investigation ,of the effects of, different 
instructional contents, iljuestion types, and question frequency. 



ERIC 



8 



Vlll 



CONTENTS 

I * ^ . * Page 
INTRODUCTION • • 

1 

Problem • j 

Purpose ' J 

Background ' . . . . • • ' 

METHOD • • • 1" * * ^ 

Subjects ^ ^ 

Procedure • * . . • ^ 

Performance' Variables. Jf^ 

Results and discussion . • • • ' 

' » 5 
Final Jest Performance . • • • ^ 

Lesson Test Scores . • •' 

Study Time Required '**'''* ^ '. * o 

Number-of . Attempts on Lesson Tests 

CONCLUSIONS «i • • ' 

' * II 

RECOMMENDATIONS. . \' • * 

DISTRIBUTION LIST . . . v | ^ . . '•VW:^-*-^- ' * 

: . . .* . f ■ 

^9 



r 




• INTRODUCTION 

V 

Problem 



The Navy Instructional Program, Development. Ce^^tefs, ynder the Chief of Naval 
Education and Training, are tasked with analyzing, designing, and cfeveloping a large 
portion of the Navy's technical training courses. The development eff drt includes writing 
practice or 5elf -study questions^tt) accompany the instructional materials. Educational 
psychologists have studied the effects of practice or adjunct queji^ extensively and 
have cpncluded that, under the proper conditions, they can faciUtatfe learning. Because of 
t^ laboratory controls employed in these studies, however, the experimental envisohment 
is quite different from that in a real-world classroom, sUuation. 

Purpose ^ ^ . ' 

The purpose of this research and development was to evaluate the effects of practice 
questions in a real-world training environment. The findings are intended to be used by 
the Instructional' Program Developmen^t Centers in farmyiating guidelines for writing 
practice questions. ^ * . ' ^ 

Backgrojind 

A considerable number" of Studies have investigated'the effects oi practice or adjunct 
questions on learning.^ Typically, in these studies, the performance of one or more 
experimental groups is compared to that of a control group. All subjects in all groups are 
given/a passage of instructional material. Those in tte experimental groups are also given 
a n^bfer of practice or adjunct questions iri which tte variables can be manipulated 
acrdw^oups in a number of ways. For example, the questions m^y be asked bdore 6r 
aftersu&ects have read the passage, ttey may be factual or inferential, they may or m^y 
not be similar or identical to those inclutted in the final test, or they may vary as to the 
number included pr the. frequency .of adminstration. Experimental subjects are usually 
required to answer the quest lops without referring back to the material. Finally, ^11 
grou{» are given, a final test,^i?^he results are compared to determine whether providing 
adjunct questions affected performance. ^ • 



^Anderson, R. C, & Biddle, W.. B. On asking people questions about what they are 
reading. In G. Boy&r (Ed.), Psychology of Ifearning and motivation (V^l. 9). New York: 



Academic Press, 1975. 



^Rothkopf, E. Z., & Bisbicos, E. E. Selective facultative effects, of interspersed 
questions on learning from written materials. Journal of Ed ucational Psychoiogyr 1967, 
58, 56-61. ! y . ^ i^^' 



Jo 



Results of such studies have shown that providing practice questions alter— as 
opposed to before— subjects have read the pertinent section of the reading passage can bef 
effective in some situations. Generally, experimental groups who are given practice 
questions after they have completed the passage perforni better than a no-question 
control group on final test questions that ar'e similsCr .or identical to-tte practice 
questior(!5, as "well as on those that are unrelated or incidental to tte p-actice questions.' 
This second finding is imfxjrtant because it sliows that providing practice questions after 
sections of ins|ructiopal materials helps the student to learn information^^hat is unrelated 
to that oJvered in the questions. Presumably, this effect occurs because tte practice 
questions focu^ the student's attention on the type of question (e.g., factual vs. 
inferential) an^&t the type of information (e.g., general vs. detailed) that will be in the 
final test. • ' , . ' . 

The implicatlonJof these findings for instructional design and development are not 
dear, j^imarily because the experimental environAient differs greatly from the real- world - 
individualized instructional environment, where students rarely are prQhibited from 
reviewing tlw instructional materials prior to answering practice questions. In a study by 
Hiller,* students were permitted to check their answers to practice questions. They, were ^ 
required to answer the practice questions, before looking bac^, however, an^ were not' 
allowed to erase any incorrect answers. This situation produced inferior pertormance in 
one conditictfi and no difference in anotter— relative to a control group—on questions 
unrelated to the inserted questions. Given these results, it may be that practice questions 
actually inhibit learning in an individualized learning environment. The present research 
examines this possibility by varying th^ number of practice*questions that ate identical to 
the test questions in an ongoing technical training course. ^ 




'See footnote 2. • • 

**Hiller, J. H. Learning from prose text: Effects of readability ftvel, inserted question 
difficulty, and individual differences. Journal of Educational Psychology , 197'*, 66, 202- 
21 r. 



. * METHOD 

• - Subjects ^ * * ' . - 

. ^ The subjects were 289 male students who were enroUed i"^*^ Circuits II <^ur^^^^^ 
the Navy's Interior Communications "A" School, San Diego^CA from November, 1977 
Jh^X May 1978. The Circuits II course is a 1-week, self-study unit comprised of sev^ 
IS. AfL a student studies the material for a le^on, he takes a lesson test, which is 
cWised of b^^ multiple-choice and matching items and ij^administered on a computer 
ThT MLMine erade for lesson tests is 70 percent. If the ^student does not reach this 
IrTterTc^, 4'muS 4Take1^ test on the computer. If he fails after tj^eejies he 
take^ written test given by the in^fuctor. Test items are not chaoged for retakes and 
•Squint b^t gfven'the' correct answer. When a student ^^^J^^^^^ ^^^^^^ , 
all seven lessons, hi takes a final test on the computer. This test includes 50 items some 
of which are identical to those included in the lesson tests. The stiKlent must answer 6(» 
^ percent of thfese items correctly incomplete the course. 

Procedure y; " 

SCibjects assigned to c^e of three experimental groups or to a <»"tr°* jrouP'/All 
of the subjec^^>QC^eded through the course as described above^ ^I^, at tte 
experimental groups, however, re<^ived a workbook containing practice questions at the 
. beginning of the course. Those in the control group did not receive a workbook. 

Although all of the workbooks contained the same number and type of questions, they 
. differed ai to the number of questions included that we^ identical to those included in 
^^jiSo7tests or in the final test. In the workbook provided to the first experimental 
gro^5^t^h^uestions were identical; in that provided to tte secorKj ^^^^^^^^.^^^^ 
fdent^^^n that provided to the third group, ndne were identical. Students in the 
three ex^rimental groups, which will be referred to hereafter as Groups ALL, HALF^r 
NONE? c^uld !Se tte workbook in any way they chose. The instruction was designed, 
hov^v^r^so that they were directed to the workbook to answer ^^f^^^^^' f!'^,^^^^^^ 
Tportio^ of the lesson materials. Because students were tested after each lesson th^y 
had^a^^portunity to become aware of the degree of similarity t^^at jested tetween 
practice ^^»d test questions as they progressed through the lesson matenals^d^^^ 
tests This procedure is somewhat different than the «^cedure used in the majority of 
adjui^it questioning studies, in which students are only given one lessoa to study and one 
^iteTion^^^ft. In this situation, the student does not have the opportunity to learn t\^ 
relationship between the practice and test questions. 

Although all students in a given -class (i.e., those ente|?ihg each week (about 20)) were 
assigned to the same group, group conditions ^^e^f/^^^^^^y^^^Sned to classes. T^^^ 
resulted in 6^^ students being assigned to Group ALL, 80 to Group. HALF, 8if to Group 
NONE, and 61 to the control group. ^ ^ 

Performance Variables 

The four groups were cbmpared on the following variables: 

1. Final test performance, inclu4ing final test score and performance on the 
following subgroups of items: • ' ' ^ 

a Those that had been seen once before (on the lesson tests) by Group HALF 
and NONE and by control group subjects. (Group ALL subjects had. seen them twice 
.before— once on the lesson test and once in the workbook.)' 
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b. * Those that had beeji |seea twice bef«>re (in the worjcbook and on the lesson 
tests) by Grotips ALL and HALF. v . • * ' ' . 

Q c Those that had pot been seen: before by Group MALF, Grdyp JvJQNE, -and 
control group subjcscts. this ^ the rtreasurfe of perf ordnance on^ufestions incidental to the 
•inserted questions.- • . v , ' ■ ' ' i ^ ; , - 



. ' 2. Scores for each lesson tiest irt the a-d^r t^l<en 

. 3. Ttrae required to complete the course (in minutes). 

■ • -.■ ' ■• •■ * *' . ■ ■•* 

' 4 



4. fpiaU numW of tries on all leSson tests (maximum of three tries' per test). 



. s 
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. RBSULTS AND DISCUSSIdN 

Final Test Performance * - - 

* ' * * , c ' 

As shown in Table i, Group ALL subjects, who had received workbooks in which aU. 
questions were identical to those in les($on. tests or in the final ' test, performed 
* significantly better oil the final test than did other subjects (F (3,285) = 57.16, g < .001). 
There was no significant 'difference in the perfortnaioce of HALF, NONE, and control * 
N. group members, even though' Group HALF subjects had been exposed to nwe of th^ final 
test questions than hiad^tfj^ in the other two groups. ' 

Final test data were^f lirthec ^analyzed by dividing test items in^^btests, depending 
pa how many times the various groups had seen the item prior to the final test. The mean 
performance of tte various study groups on these subtests is included in Table 1. Results 
oj an apalysis of variance performed on subject results are described below: 

I- ' • 

1. Subtest comprised of items seen once before— Control group members, who had , 
no workbook^ scored significantly higher on this subtest than did members of ' Groups 
HALF and NONE (F (2,212) = 5.33, p < .005). A possible explana^on f«r this result is th*t . 
students in the HALF and NONE groups learned that qi^stions seen before were not Ukelyf 
to be repeated. Therefore, they may not have tried to remember them or they may not 

♦ ^ have studied the material related to them while preparing for the final test. 

2. Subtest comprised of items seen twice before— Group ALL subject^ performed 
' significantly better on this subtest than did Group HALF subjects, even though both 

groups had an equal amount of exposure to\the items, this result is consistent with that 
for the subtest comprised of iteitis seen ondfeybefofe and may be explained in the same 
way. ' . X 

3. * Subtest comprised of items only on the firal test— Thfese items are comparable to 
the "incidental" questions in the typical adjunct question study. There, was no signific^t 
difference in t^ performance of members of Group HALF, Group NONE, and the control 
group on thisv^btest. Thus, the presence of practice qu^ions did not facili^te the 
performance of Groups HALF and NONE relative to that of tte control group. 

Lesson Test S<yres ^ ^ 

figure 1 co/^pares the mean performance of the study groups on the seven lesson 
tests. It should be noted that subjects were not required to study the lessons in .any 
particular orderf. Thus, one subject in a particular 'group may. have taken Lesson 2 first; 
and another, LeWon 7. Since this mea<l^ compares performance on the lesson tfsts in 
the order they were taken, data from different tests can contribute to a given data point. 
This did not present a problem in Interpreting results, hoWever^ since all of the lessons 
were independent in topic and there were no systematic differences between groups in the 
order in which lessons were completed. ^ 

As shown in Figure 1, the performance of Group ALL subjects was superior to that of 
the other three. Group HALF subjects generally performed between than those in Group 
NONE and the control group. Both main effects and the interaction are significant: F 
groups (3,285)^= 68.67, p <. .001; F lessons (6,1710) = 28.j6, £ < .001; F interaction 
(18,1710) = 3^62, £<. 001. ' ^ X 

. It is interesting to note the data for the first lesson. Here the groups order as 
follows'. ALL, HALF, control, and NONE, with large differences between the HALF and 

■ • - ■ ■ '■ h ■ ' 



Table 1 ' . 

Comparison of Mean Performance by Study Croups , 



Variable 


• 

Group ALL 

' '. 


Group HALF 


; 1-7 ; 

Group NONE 


• Control 
Group 


I. Final test— percent correct 


92.22 

> 


78.96 


76.72 

• 


78.25 


* 2* Sutttest of final test questions that had been seen 
- once before (N = 29) (i.e., on the lesson tests) by 
Groifl> HALF, Group NONE, and the control groui>-- 

percent correct 


N/A 


76. ()0 


77.00 


,81.00 


Subtest of final, test questions that had. been seen 
ON twice before (N = 8) (i.e., in the workbook and oi^ 

lesson tests) by members of Groups ALL and HALF— 
percent correct * ^ 


1 93.50 


• 

• 

89.00 


N/A 


N/A 


f^. Subtest of final test questions seen only on 
xinal test vN = iz/ oy memDers oi vjroups nrvi^r, 
NONE, and the control group— percent correct 

5. Time required to complete unit (minutes) 


V ^ 

N/A 
36*. 00 


78.00 
W.23 


7'>.86 

* • 

4*3.89 


'' W.71 


6. Total number of tries on all lesson tests 
(minimum = 7, maximjiHn = 21/ 


7 17 


§ » r T 


/ 8.96 


8.30 


\ * 

i 






* * • 
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Figure 1. Mean performance of study groups. on Icssofi tests in the order taken. 
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ALL groups and the control^d NONE groups. This result can be explained by assuming 
that the experimental grouiw began the course using the worldxiok questions to guide their 
study behavi<k-. For those in Group ALL, this was an optimal strategy/" since their 
workbook questions were identical to th6 test questions. For those in Group HALF, only 
half of the workbook questions were the same, so they.did not perform as well as those in 
Group ALL. Those in the control group had no workbook and no guideUne^ consequently, 
they apparently tried to study ev.erything and performed almost as well as those in Group 
KALF. Finally, those in proup NONE - foural that their guidelines were completeh^ 
.rinaccuriite, and, not surprisingly, thay had the lowest performance. After the first lessorf. 
Group NONE subjects Apparently realized that their workbook was misleading and t*— ' 
began to study everything. As a result, their performance became more like that of 
control group. It i^s apparent from this analysis, and from the final^ tfest data* M^t. 
practice questions play a' major role in shaping study bdiaviors. 

, ■ * » ♦ 

The general decline in performance for all groups, particularly on the last test taken, 
can be attributed to two factors. First, subjects tended to leave the more difficult tests 
until last. Second, the fact that «t hey were permitted to leave class early on the final day 
if they finished the final lesson and passed the final lesson test produced a "goal gradient" 
effect,. . . : ' 

Stiidy Time Required ^ 

Based on the assumption discussed above (i.e., that students begin tije course by using 
. their wqrkbook and adjust their study behavior depending on how much it he^ them), it 
can be predicted that (1) Group NONE and , control group subjects would require 
approximately equal time to complete the course, since they would need to study all of 
the material! (2) Group HALF subjects woul4 require less time because of their e)^o?ure 
to more questions identical to those in lesson and/or final tests; and (3) Group<i\LL 
subjects would require the least amount of time, because they had been 'exposed to all of 
the test questions. As sY^wn in Teible 1, group means, expressed in minutes, w^e 
generally as p!«dicted. An ANOVA performed on study time data showed a significant 
difference among groups: F.(3,285) = 10.18, £ <*.0Ol. 

Number of Attempte cti Lesson Tests 

As indicated previously, a student could take each lesso 
the computer if he continually failed. Thus, the-namber of 
range from 7 to 21. Given the previous findings* the groups wt 
follows on this variable: Group ALL, Group HALF, control grou^ 
assumption was supported, as shown by tl^ group means in 




to three times on 
^lesson tests coultf 
expected^ order as 
Group e40NE. This 
ble 1. An ANOVA 



performed on lesson test data showed a significant difference among groups: FU,255; 
26.60, p < .001. 
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CONCLUSIONS 



Two conclusions can be drawn from tte results from the final test and tbe subtests. 
Flrstf adjunct que^lons in this situation did not help students learn informatioh incidental 
to the adjunct questions. Second, students in the HALF and NONE Groups apparently 
realized that the questions in their workbook were not likdy to be included in tests; thus, 
they did not pay as much attention to the lesson test questi<»\s as those in the ALL Group, 
who learned* that questions in their wc>rkbook would be included in the tests, and the 
control group, who* had no workbook ^or gulc^ce. As a result, students- in the HALF and 
NONE Croups did not perform as well as the others on questions identical to the lesson* 
test questions. Thus, adjunct questions had an inhibiting effect on their performance. 
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RECOMMENDATIONS f 

It is clear that practice questions have im{x>rtant effects on perfoTimance, study 
behavior, and study time. These results, which confirm arid extend Hiiler*s (197*^) findings, 
" have direct implications for the design and development of individualized instriKrtional 
materials. If the intent of the instruction is to have students remember important pieces 
of infortmatiOT (as in the [Resent stiKly), ^ practice itef7> and a test item should be 
individual for eacYi piece of\ informatioli. There should be no practice on information that 
will not be tested. If time and resource constraints cto not permi^t all important 
% information to be tested, the course matericil should J>e prioritized sp that the mo§t 
• cruciel inforhiation' can be practiced and tested. The same prescript iwi applie§ to 
classroom instruction whjere th^ teacher' provides practice by oral quizzing or in 
"^workbooks, amd to other situations in which informatics is to be memorized. If the intent 
of the educational program is to transfer learning to new situations, however, practice 
items would necessaril-y not "be the same as test items. 

Future research on practice questions should be accomplished in an ongoing training 
program, and should investigate the effects of different instructiwi content, different 
.'^ *question types, and different question frequency. * 



L 



\ ■ 



• X 



ERIC 



.11 ^'0 



s 



DISTRIBUTION UST 

Chief of Naval Operations (OP- 102) (2), (OP-1 1), (OP-96'fD), (OP-9«7H) 

Chief of Naval Research teode«»50H*), (Code 58) (2) ^ , . K 

Chief*of Information (01-2252) ^ . ^, 

Director of Navy Laboratories ' " . . ' 

Commandant of the Marine Corps (MPI-20) . ^ ' 

Chief of Naval Education and Training (00 A), (N-2), (N^), (N-9) 
Chief 6f Naval Techni<!al Training (code 016) ~ 
Chief of Naval Education and Training Support 
Commander Training Command, U.S. Pacific Fleet . . 

Commander Training Command, U.S. Atlantic Fleet (Code N3A) 
-Commander, Naval Military Personnel Command (NMPG-013*C) 
Strategic System Project Office (SP- 15) ' ' * . 

Commanding Officer, Fleet Combat Training Center, Pacific 
Commanding Officer, Fleet Combat Tre^ining Centpr, Pacific (Cod^ OOE) 
Commanding Officer, Fleet Training Center, San Diego • * ■ t 

Commanding Officer, F]eet Anti-Submarine Warfare Training Center, Pacific 
Commanding Officer, Naval Education and Training Programfi DevelofMnent Center (Tech- 
nical Library) (2)« ' • 
Commanding Officer, Naval Development and Training Center (Cc«le 0120) 
Commanding Officer, Naval Aerospace Medical Institute (Library Cod^l2) (2) 
Comman^ng Officer, Naval Technical Training Center (Code OlE) 
Commanding Officer, Naval Damage Control Training Center 

CommandiAg Officer, Naval Education and Training Support Ceater, Pa^H<^4£^ ^^^^ 
Commanding Officer, Naval Health Sciences Education and Training Comm<bvl (Code 2) 

(2) 

Commanding Officer, National Naval Dental Center (Library) 
Commanding Officer, Naval Training Equipment Center (Technical Libfary) 
Commanding Officer, Service School Command* San Diego 

Officer in Charge, Naval Instructional Program Development Detachment.'^Great Lakes 
Officer in Charge, Naval Education and Training Information Systems Activity, Memphis 
Detachment . 

Officer in Charge, CentrafeTest Site for Personnel and Training Evaluation Program 
Director, Training Analysis aaid Evaluation Group (TAEG) 

Director, Career Information and Counseling School, Service School Command, San Diego 

(Code 3722) 
President, Naval War College 
Provost, Naval Postgraduate School 

Master Chief Petty Officer of the Force, Naval Education and Training Command (Code 
003) 

Technical Library, Air Force Human Resources Laboratory (AFSC), Brooks Air Force Base 
Flying Training Division, Air Force Human Resources Laboratory, Williams Air Force Basfe 
CNET Liaison Office, Air Force Human Resources Laboratory, Williams Air Force Base • 
Technical Training Division, Air Force Human Resources Laboratory, Lowry Air Force 
Base 

Army Research Institute for the Behavioral and Social Sciences (Reference Service) 
Army Research Institute for the Behavioral and Social Sciences (Field Unit— US^R EUR) 
(Library) 

Military Assistant for Training and Personnel Technololgy, Office of the Under Secretary 

of Defense for Research and Engineering 
Commandant, Industrial College of the Armed Forces 
Director, Defense Activity for Non-Traditional Educational Support 



^1 



13 



ERIC 



Secretary Treasurer, U.S. Naval Institute 

Science and*fechnology Division, Library of Ccmgress 

Coast Guard Headquarters (G-P- 1/62) 

Defense Documentation Center (12) 



\ 



6 



22 



